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Abstract 

An  experiment  was  eonducted  to  investigate  the  utility  of  a  number 
of  iconographic  styles  in  relaying  ordinal  depth  information  at  vista 
space  distances  of  more  than  1900m.  The  experiment  consisted 
of  two  tasks:  distance  judgments  with  respect  to  discrete  zones, 
and  ordinal  depth  determination  in  the  presence  of  icon  overlap. 
The  virtual  object  representations  were  chosen  based  on  their  ef¬ 
fectiveness,  as  demonstrated  in  previous  studies.  The  first  task  is  an 
adaptation  of  a  previous  study  investigating  distance  judgments  of 
occluded  objects  at  medium  field  distances.  We  found  that  only  one 
of  the  icon  styles  fared  better  than  guessing.  The  second  is  a  novel 
task  important  to  situation  awareness  and  tested  two  specific  cases: 
ordinal  depth  of  icons  with  50%  and  100%  overlap.  We  found  that 
the  case  of  full  overlap  made  the  task  effectively  impossible  with 
all  icon  styles,  whereas  in  the  case  of  partial  overlap,  the  Ground 
Plane  had  a  clear  advantage. 

Keywords:  Augmented  reality,  human  factors  evaluation,  situa¬ 
tion  awareness,  ordinal  depth.  X-ray  vision. 

1  Introduction 

Many  challenges  have  limited  the  ability  of  AR  systems  to  pro¬ 
vide  adequate  situation  awareness  (SA)  information,  particularly 
distance  information  for  virtual  object  representations.  The  exper¬ 
iment  outlined  in  this  abstract  investigates  the  utility  of  various 
visual  representations  in  providing  distance  and  ordinal  depth  in¬ 
formation  for  occluded  objects.  It  is  a  continuation  of  a  previous 
study  [4]  which  investigated  judgments  of  virtual  object  placements 
at  medium  field  distances.  As  in  our  previous  work,  we  used  out¬ 
line  shapes  for  military  standard  icons  [3]:  a  square  and  a  diamond. 
These  shapes  were  accompanied  by  four  occlusion  representations 
(Figure  1),  as  well  as  a  baseline  case  in  which  no  distance  informa¬ 
tion  appeared  with  the  icon. 

•  Distance  Label 

Egocentric  distance  (meters)  was  displayed  beside  each  icon. 

•  Ground  Plane 

Concentric  circles,  centered  at  the  user,  with  ’’tie  lines,”  ex¬ 
tending  downward,  provide  distance  information  [5,  6]. 

•  Virtual  Wall 

This  technique  was  taken  from  [4],  without  further  adaptation. 

•  Virtual  Tunnel 

We  altered  the  technique,  as  presented  in  [1,  2,  4]  to  represent 
’’tunnels”  through  discrete  distance  zones,  instead  of  objects. 

Two  tasks  were  used  to  measure  the  effectiveness  of  each  rep¬ 
resentation  at  relaying  distance  information:  determining  ordinal 
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depth  relative  to  the  real  world  (Zone  Identification),  and  identify¬ 
ing  the  closer  of  two  overlapping  virtual  objects  (Proximity).  These 
fundamental  tasks  are  critical  to  establishing  and  maintaining  SA, 
and  thus  constituted  appropriate  tasks  for  our  evaluation.  Further¬ 
more,  the  virtual  objects  in  this  experiment  are  at  far  greater  dis¬ 
tances  than  in  previous  evaluations. 

2  User  Study 

We  conducted  a  single  user  study  with  two  separate  tasks,  both  of 
which  were  performed  by  each  participant,  outdoors  in  an  open 
parking  area  with  an  unobstructed  view  of  an  airport  and  surround¬ 
ing  buildings.  All  virtual  representations  were  placed  in  and  around 
the  airport  and  buildings  at  distances  greater  than  1900m. 

2.1  Experimental  Hardware 

A  custom  prototype  AR  display  was  used  in  this  study.  It  was  a 
monocular,  monochrome  green,  holographic  display  with  a  resolu¬ 
tion  of  1024x768  and  field  of  view  of  40°  x  30°.  Three  to  six  layers 
of  0.3  neutral  density  filter  (one  f-stop,  50%  transmission)  helped 
balance  the  brightness  of  the  graphics  with  the  brightness  of  the 
real  environment.  The  display  was  mounted  to  a  rigid  frame  to  con¬ 
trol  registration  error  and  prevent  unwanted  motion  due  to  wind  and 
other  environmental  factors.  The  frame  enabled  freedom  of  move¬ 
ment  in  the  vertical  direction,  allowing  the  height  to  be  adjusted 
for  each  user.  The  graphics  were  rendered  by  a  platform  consisting 
of  a  3.4  GHz  Pentium-D  processor  with  2.87  GB  of  RAM  running 
Windows  XP  and  an  NVIDIA  GeForce  7950  GX2  graphics  card. 

2.2  Experimental  Tasks 

Reaction  time  was  recorded  in  addition  to  the  task  responses  below. 

Zone  Identification  The  real  environment  was  partitioned  into 
three  discrete  zones:  the  area  in  front  of  the  airport  buildings  (1900- 
2500m),  from  the  airport  buildings  up  to  the  city  skyline  (2500- 
3100m),  and  beyond  the  city  skyline  (3100-3600m).  Users  were 
then  tasked  with  identifying  in  which  of  the  three  zones  each  virtual 
object  representation  was  placed  [4].  For  each  trial,  users  viewed 
two  icons  drawn  in  the  same  occlusion  style.  The  zone  placement 
was  independent  for  the  two  icons,  and  users  sequentially  entered 
their  responses,  leftmost  icon  first  followed  by  the  rightmost. 

Proximity  Task  Pairs  of  icons  at  Half  (50%)  and  Full  (100%) 
overlap  were  shown  to  users,  who  determined  which  of  the  two  was 
closer.  They  were  not  forced  to  guess,  and  an  option  was  included 
for  them  to  indicate  that  the  information  provided  by  the  represen¬ 
tation  was  to  inadequate  to  conjecture  a  response. 

2.3  Subjects  and  Procedures 

Eighteen  subjects  (14  male,  4  female),  18-56  years  of  age 
(mean=33),  participated  in  the  study.  All  reported  normal  or 
corrected-to-normal  vision  and  average  to  heavy  computer  use. 
Two  reported  significant  experience  with  head- worn  AR  displays. 

Before  beginning  the  experiment,  the  display  was  adjusted  to  the 
user’s  eye  height,  and  a  calibration  image  set  was  used  to  adjust 
the  yaw  and  pitch  of  the  display  according  to  user  feedback.  Each 
subject  was  provided  an  overhead  map  of  the  area,  and  a  thorough 


Figure  1:  Views  through  the  HMD  of  several  representations  used  in  this  study.  Left  to  Right:  Ground  Plane,  Distance  Label,  Virtual  Tunnel, 
Virtual  Wall  (all  from  the  Zone  Identification  task).  Ground  Plane  50%  overlap.  Ground  Plane  100%  overlap  (both  from  the  Proximity  task). 


Ground  Label  vwaii  Tunnel  None  Ground  Label  VWall  Tunnel  None 


Figure  2:  Occlusion  representation  had  a  main  effect  on  both  error 
(blue)  and  response  time  (green)  for  Zone  Identification.  Users  were 
most  accurate  with  the  Virtual  Wall,  but  trended  faster  with  the  Virtual 
Tunnel.  Error  bars  in  all  graphs  denote  one  standard  error  unit. 


0.6  T  r  -0.75 


L  0.25 

Ground  Label  VWall  Tunnel  None 


Figure  3:  The  signed  error  (red)  showed  a  main  effect  on  Zone  Iden¬ 
tification  based  on  occlusion  representation;  by  comparing  this  with 
the  error  rate  graph  (blue,  repeated  from  Figure  2),  we  can  under¬ 
stand  both  the  frequency  and  direction  of  errors.  In  the  signed  error, 
positive  error  means  that  users  said  the  object  was  farther  than  it 
really  was;  negative  error  means  users  said  it  was  closer. 


Figure  4:  Analysis  of  the  Proximity  task  for  error  (blue)  and  re¬ 
sponse  time  (green),  separated  into  sub-cases  of  Half  overlap  (lighter 
shades)  and  Full  overlap  (darker  shades),  showed  the  Ground  Plane 
enabled  almost  error-free  performance  in  the  case  of  Half  overlap, 
but  revealed  no  significant  differences  in  the  case  of  Full  overlap. 

resentation  and  amount  of  icon  overlap.  Error  was  significantly 
higher  for  Full  overlap,  and  participants  were  most  accurate  with 
the  Ground  Plane,  but  only  in  the  50%  overlap  condition  (Figure  4), 
making  only  one  mistake.  Similarly,  users  felt  confident  enough  to 
respond  with  the  Virtual  Wall  and  Virtual  Tunnel  in  the  50%  case. 

4  Conclusions 

Some  issues  with  the  occlusion  representations,  such  as  legibility, 
may  have  limited  their  utility  and  user  performance.  The  brightness 
of  the  real  environment  may  have  also  inhibited  the  effectivness  of 
the  display.  Future  revisions  may  benefit  from  alterations  to  the 
representations  to  optimize  them  for  the  environmental  conditions. 
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